Figure 2.23 - Pivot example
That will always happen if you use the default settings for pivot points.
By default, Blender uses the Median Point of a selection as the pivot. At
the 3D Viewport header, you will find the options for pivot points in
Blender (Figure 2.24).
Figure 2.24 - Pivot options
There you can set different ways to handle pivot points: